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ADAPTIVE SUBTRACTION IMAGE COMPRESSION 

BACKGROUND OF THE INVENTION 

[0001] Digital imaging technology is essential to diagnosis of a variety of 
diseases including cancer, heart disease, brain disorders, and many other 
conditions in both humans and animals. The ability to acquire, analyze, transfer, 
and store detailed images of tissues and organs permits rapid and accurate 
diagnosis of disease and therefore better and more accurate treatment for the 
patient. Digital images for use in medical diagnosis are often obtained as a series 
of images representing adjacent slices of a target such as an organ (e.g., liver, 
heart, brain) or other portion of the body. Radiologists and other medical 
professionals analyze the series of images to locate and identify potential 
pathological conditions. The use of a digital image series is not limited, to tiie 
medical profession. For example, dvil engineers may obtain images of roads, 
bridges, buildings, and other structures for analysis. Time lapse photography 
may be used to analyze the movements of stars, planets, meteors or other cosmic 
structures. Digital images of secure areas, locations, or objects may be used to 
determine if such areas, locations, or objects are moved or changed over time. 

[0002] Billions of digital images for these and other applications are 
generated every year requiring considerable resources to analyze and transmit 
the images. For example, telemedidne relies on the ability to share medical 
images with professionals located in distant geographic locations. However, the 
available computer infrastructure for manipulating and transmitting large . 
numbers of digital images is often limited or imavailable. Transmission of large 
numbers of images is limited by the bandwidth of currentiy available networks 
(e.g.. Hie Internet, phone lines, wireless transmission, satellite). Furthermore, the 
cost of tiransmitting large numbers of images is high and tiie availabiUty of high 

1 



wo 2004/093001 PCT/US2004/0 10987 

bandwidth transmission is limited- Thtis, images created with the most 
sophisticated technologies often need to be sent using slower and less efficient 
forms of delivery (e.g., courier or mail). 

[0003] Rapid retrieval of these images is also limited by the size of the 
image files. Medical facilities, for example, must be able to rapidly retrieve 
images to meet the standards of the medical profession and comply with laws 
and regulations. Large image files are cumbersome and difficult to review and 
manipulate with many standard desktop systems. Companies may therefore be 
required to invest large amounts of capital in computer systems capable of 
efficiently and rapidly retrieving large image files. 

[0004] Compression algorithms, such as JPEG, may be used to reduce the 
size of image files. Most lossy compression techniques have limited applicability 
where detection of minute differences between images in a series is critical. The 
loss of a small amoimt of detail may be tolerable for certain applications (e.g., 
entertainment media). In these non-critical applications, a user can balance the 
need for compression of the image size against the need for additional detail in 
the image. Critical application users (e.g., medical professionals) cannot tolerate 
the loss of detail that may be necessary to identify pathology in an image or 
series of images of a potentially diseased organ. 

[0005] Medical images may be acquired using techniques such as 
computed tomography ("CT'') or magnetic resonance (''MR")- CT uses x-rays to 
image the body. As x-rays pass tiirough fixe body, they are absorbed or 
attenuated at various levels creating a matrix or profile of x-ray beams of 
different strength. A rotating frame in the CT scanner has an x-ray tube mounted 
on one side and a detector motmted on the opposite side. A fan-shaped beam of 
x-ray radiation is created as the rotating frame spins the x-ray tube and detector 
aroxmd the patient. Each time the x-ray tube and detector make a 360*=* rotation, 
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one or more images or slices has been acquired. The images represent slices of 
the body, and are usually completed in a series. The spacing between slices is 
typically less than five millimeters. The x-ray tube and detectors are normally 
moved along the long axis of the body to acquire axial images that illustrate the 
section of anatomy being studied. Typically, one or more coronal images are 
constructed as scout images to iadicate the positioning of each axial image. An 
additional series of images may be acquired after a high-contrast material is 
injected into the patient. A derived image series may be computed from the 
original series to contain different windows for display, i.e., bone, lung, brain, etc. 
A derived series may also be created by different computer processing 
techniques such as enhancement filters and/or reconstruction. 

[0006] MR uses magnetic energy and radio waves to create cross- 
sectional images or slices of the human body. Current MR scanners perform an 
examination typically comprised of 2 to 12 images in a series. An MR series is an 
acquisition of data that yields a specific image orientation and a specific type of 
image appearance. Among the benefits of MR are that it can differentiate tissue 
clearly and easily acquire direct views of the body in almost any orientation, 
while CT scanners can display bone fractures and typically acquire axial images. 

[0007] There are a variety of compression methods of images described 
in the art. For example, the popular MPEG compression method is used to 
compress motion in video and eliminate significant differences between frames 
to exploit the limitation of the human eye, which cannot perceive differences that 
are visible in just a single frame when observing video recorded at 30 frames per 
second. MPEG compression is not applicable to diagnostic or medical imaging 
where the objective is to preserve significant differences between slices tiiat may 
be indicative of pathology. 
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[0008] The paper, Karadimitriou and Tyler, Min-Max Compression for 
Medical Image Databases, ACM SIGMOD Record Voltime 26, Issue 1, pgs. 47-52, 
1997, describes the redxmdancy in sets of similar images (series) that occur in 
cross-sectional imaging. The encoding method discussed in Karadimitriou and 
Tyler refers to fitting a curve between the smallest and largest pixel value found 
at each pixel coordinate throughout the series. This method compresses images 
by a maximiun factor of 3.4:1 as it does not remove random noise. 

[0009] U.S. Patent No. 6,269,193, "Young et al.," refers to a compression 
method for use with a specific imaging device. The compression method refers 
to segmenting the foregroimd of an image followed by quantizing the pixel 
values of the foreground image below a calculated noise threshold. For example, 
if it is known that only 512 grayscales are significant out of the 65536 possible 
grayscales in a 16 bit image, ihen the 65536 grayscales can be mapped to 512 
significant grayscales. However, tfus method can generally be implemented only 
by the manufacturer of the imaging device as each model and software version of 
imaging devices may have significantly different grayscale characteristics. 

[0010] The paper, "Entropic Estimation of Noise for Medical Volume 
Restoration," by Lieven et al. asserts that when adjacent CT or MR images are 
subtracted pixel-by-pixel from adjacent images within a series, the noise 
component doubles while most of the signal component is eliminated. 
Proceedings of the International Conference on Pattern Recognition ICPR'02, 
2002. The histogram of this subtracted image is found to approximate a Gaussian 
distribution centered arotmd 0 indicating the presence of a significant amoimt of 
"random noise." The Lieven et al. article refers to the removal of noise in order 
to improve 3D volume rendering rather than for use in compression of imiages. 

[0011] The paper entitled, "A rapid and efficient method data 
compression method for image time series," by Cohen refers to the use of 

4 



wo 2004/093001 PCT/US2004/0 10987 

"thresholding" to remove random noise prior to compressing images that belong 
to a series. While the thresholding algorithm described by Cohen slightly 
improved the compression ratio, the output images were distorted and thus 
unsuitable for use in medical imaging, for example, because clinically significant 
information was not necessarily preserved. 

[0012] U.S. Patent no. 4,939,645 ("the '645 patent") refers to a variety of 
computational methods for preserving the natural look of a diagnostic image that 
has been subject to lossy compression. However, the '645 patent is not directed 
to compression and refers to improving the appearance of images that have been 
subject to lossy compression. 

[001 3] What is needed are compression methods that substantially 
reduce the size of a series of digital images while preserving significant 
information contained in the original series of images. 

BRIEF SUMMARY OF THE INVENTION 

[0014] A preferred embodiment of the invention is directed to a method 
of compressing a series of digital images by arranging the images in an ordered 
series from 1 to n wherein n is the last image in said series. Each pbcel of each of 
images 2 to n are subtracted from its corresponding pixel in its adjacent image to 
create a subtracted image. Pixels having an absolute value less than a 
predetermined threshold value are adjusted to zero to create a thresholded 
image. The resulting thresholded image is compressed using a suitable 
compression algorithm (e.g., JPEG lossy, JPEG lossless, JPEG 2000 lossy, JPEG 
2000 near lossless, JPEG 2000 lossless, JPEG-LS, RLE, Deflate, Lempel-Ziv) to 
form a compressed image. Another embodiment of the invention is directed to 
decompressing an image or reconstructing the compressed images using an 
associated decompression algorithm to form thresholded images and adding the 
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pixels of each ttiresholded image 2 to n to the pixels of its adjacent reconstructed 
image. Alternatively, the adjacent images that were subtracted from during 
compression may be reconstructed adjacent images. 

[0015] Methods of storing images compressed in accordance with the 
invention by encoding the images in a storage format including, but not limited 
to AVI, Bitmap, DICOM, GIF, TEFF, JPEG, MPEG, PNG, Windows Media, and 
storing the images in a storage medium including, but not limited to fixed disk 
drives, magnetic disks, optical disks, magneto-optical disks, random access 
memory, flash memory, or cache memory are also provided. Yet another 
embodiment is directed to methods of transferring images compressed in 
accordance with the invention by encoding the images in a transfer format, 
providing the images to an image soxirce system, transferring the images from 
the image source system through an image transfer mechanism to an image 
receiving system. Transfer formats include, but are not limited to TCP/IP, 
IPX/SPX, NetBEUI, ATM, or 802.11. Transfer mechanisms include, but are not 
limited to, network, Internet, telephone line, satellite, wireless, microwave, or 
fibre. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0016] FIG. 1 depicts a histogram of an exemplary subtracted image; and 

[0017] FIG. 2 depicts a histogram of an exemplary thresholded, 
subtracted image. 

DETAILED DESCRIPTION OF THE INVENTION 

[0018] Reference will now be made in detail to the presently preferred 
embodiments of the invention, which serve to explain the principles of the 
invention. It is to be understood that the application of the teachings of \he 
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present invention to a specific problem or environment will be within \he 
capabilities of one having ordinary skill in the art in light of tfie teachings 
contained herein. 

[0019] The present invention is directed to methods and systems for 
compressing a digital image series. These methods and systems achieve a 
substantial reduction of storage required for the image series, and increase the 
speed of transferring or transmitting the image series, or reduce the bandwidth 
required for transferring or transmitting the image series. The compression 
methods and systems of the invention exploit the information redundancy within 
a digital image series (e.g., a cross-sectional diagnostic image series) to deliver 
significantly higher compression ratios than existing lossless and near-lossless 
methods such as JPEG lossless, JPEG-LS, or JPEG2000 lossless. Preferred 
embodiments of the methods arid systems of the invention also eliminate noise 
using an adaptive threshold to avoid removing significant information during 
compression (e.g., diagnostic information) imlike JPEG lossy, JPEG2000 lossy, 
and other common wavelet methods. 

[0020] The methods and systems of the invention permit near-lossless 
and lossy compression of digital images to reduce the memory required to store 
digital image sets and the time or bandwidth required to transmit digital image 
sets. The compressed images can be decoded and uncompressed 
("reconstructed'') at the receiving end of the transmission for display. The loss of 
significant information in reconstructed image sets is minimized using the 
methods and systems of the invention. The amotmt of additive noise and CPU 
time is minimized in accordance with preferred embodiments of the invention. 

[0021] The term "digital image" refers to a series of pixels that represent 
an image and is capable of being stored in and retrieved from computer memory. 
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The term "a series of digital images"' refers to a set of images 1 to n where each 
image has an adjacent image (e.g., a preceding image or a subsequent image). 

[0022] The term "subtracted image" refers to an image created by pixel- 
by-pixel subtraction of pixels from its adjacent image. 

[0023] The term "random noise'' refers to pixel values normally 
distributed aroimd a mean value. Random noise has a mean value of zero in a 
subtracted image as long as the source of noise remains constant throughout the 
image series. 

[0024] The term "fhresholded image" refers to an image created by 
setting all pixel Vcilues whose absolute value is below a predetermined threshold 
ntraiber to zero. 

[0025] The term "lossy compression" refers to an algorithm for which 
one or more reconstructed image pixels differ from its corresponding original 
image pixel. "Near lossless compression" refers to an algorithm for which each 
reconstructed image pixel differs from its corresponding original image pixel by 
not more than a pre-spedf ied value. "Lossless compression" refers to an 
algorithm for which each reconstructed image pixel is identical to its 
corresponding original image pixel. 

[0026] The term "entropy" refers to the amoimt of information in a 
signal. An image with many pixels with common pixel values is regarded as low 
entropy whereas an image with many pixels with varying pixel values is 
regarded as high entropy. 

[0027] A preferred method of the inv^tion is directed to a method of 
compressing a series of digital images by arranging the images in an ordered 
series from 1 to n wherein n is the last image in said series. The images may be 
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arranged from first to last or last to first or in any other suitable logical sequence. 
The images can optioneJly be registered williin a series to eliminate alignment 
errors due to patient movement. Image registration significantly reduces 
structural differences between images and thus reduces "structmal noise" that 
may remain in a subtracted image by decreasing the number of non-zero pixel 
values. Image registration may include trcinsformation, shearing, and other 
mathematical techniques to ensure that large structures that are present in 
adjacent images occupy the same relative position. 

[0028] After the digital images are arranged in a series, each pixel of each 
of images 2 to n is subtracted from its corresponding pixel in its adjacent image 1 
to (n-1). An "adjacent image'' can be a previous adjacent image or a subsequent 
adjacent image. Pixels having an absolute value less than a "predetermined 
threshold value" are adjusted to zero. The methods and systems of the invention 
achieve significant additional compression ratios by this removal of "random 
noise" from subtracted images. Any "random noise" contained in the subtracted 
images should approximate a normal distribution with a mean pixel value of 0. 

[0029] In one embodiment of the invention, the presence of "random 
noise" in each of the subtracted images is confirmed by applying a Normality 
Test to verify that suspected "random noise" generates a normal distribution. 
Suitable Normality Tests are well known in the art (e.g., NIST/SEMATECH e- 
Handbook of Statistical Methods, http://www.itLnist.gov/div898/handbook/, 2003; 
Conover, W. J. 1980. Practical Nonparametric Statistics. 2nd ed. New York: John 
Wiley & Sons; D Agostino, R. B. and Stephens, M. A., eds. 1986. Goodness-of-fit 
Techniques. New York: Dekker; Daniel, Wayne W. 1978. Applied Nonparametiic 
Statistics. Boston: Houghton Mifflin hereby incorporated by reference in th^ 
entirety). A Normality Test verifies that pixel values are distributed within a 
preset tolerance of a normal distribution. Only the pixels that we are planning to 
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set to zero by thresholding, exduding those pixels that already contain a value of 
zero, should be tested for normality. If suspected "random noise" is not within a 
normal distribution, it may contain non-random information. If a particular 
image fails a Normality Test, then a smaller threshold value must be selected or 
thresholding should not be performed because thresholding would have a high 
probability of removing significant information. 

[0030] For example, if it is determined that 1.5 standard deviations of 
noise can be safely removed without loss of significant information, then the 
noise can be replaced with pixel values of zero. By removing the majority of 
noise in this subtracted image, the entropy contained within this subtracted 
image is reduced significantly as the image now contains many more zero valued 
pixels as depicted in FIG. 2 (Thresholded Histogram) when compared with FIG. 1 
(Normal Histogram). 

[0031] The following definitions are used in the examples that follow: 

In(x,y) = Original pixels of image # n within the series 

DIn(x,y) == Thresholded, subtracted image reqxured to reconstruct 
image # n 

an = standard deviation of subtracted image # n 

In'(x,y) = Reconstructed Image # n 

[0032] An exemplary function ("Algorithm for Threshold (DL)'') 
eliminates Gaussian noise from a subtracted image by modifying the input image 
to set pixels to 0 that are within a standard deviations of 0. For medical 
applications, a must be tuned to provide a diagnostically acceptable output. 

If |DIn(x,y) |>a*anthenOutput«DIn(x,y) 

10 



wo 2004/093001 PCT/US2004/010987 

If |DL.|<=a*crniiienOu1put = 0 

[0033] The resulting subtracted image is compressed using a suitable 
compression algorithm (e.g., JPEG lossy, JPEG lossless, JPEG 2000, JPEG-LS lossy, 
JPEG-LS near-lossless. Wavelet, RLE, Deflate, Lempel-Ziv) to form a compressed 
image. The size of an image can be reduced by at least about an additional 60% 
using the methods and systems of the invention. 

[0034] Los^ compression can be achieved using tihe methods and 
systems of the invention according to the following exemplary algorithm: 

Algorithm for Lossy Compression: 

h'(x,y) = Ii(x,y) 

Dl2(x,y) = Threshold(L(x,y) - Ii(x,y)) 

DI„(x,y) = Threshold(I„(x,y) - L-i(x,y)) 

l2'(x,y) = Ii(x,y) + Dl2(x,y) 

In'(x,y) = Lvi'(x,y) + DIn(x,y) 

[0035] The compressed series consists of Ii and DI2. . .Din all of which are 
to be lossless or lossy compressed using JPEG, JPEG2000, or other standard 
methods. 

[0036] Alternatively, embodiments of the invention provide near lossless 
compression. Near lossless compression requires that the maximimi error in any 
pbcel of the image is quantifiable. The objective is that the maximum error is to 
be within the magnitude of the "random noise." This is achieved by using 
reconstructed images during the subtraction rather than original images. The 
reconstructed images contain the error introduced by thresholding. By 
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accounting for that error during encoding, the decoder generates a more precise 
image with the only error introduced by a single thresholding step rather than an 
additive error propagating through each image. The following is an exemplary 
algorithm for near lossless compression: 

Algorithm for Near-Lossless Compression: 
IiXx,y) = Ii(x,y) 

Dl2(x,y) = Threshold(l2(x,y) - Ii(x,y)) 

l2'(x,y) - Ii(x,y) + Dl2(x,y) 

DIn(x,y) = Threshold(In(x,y) - In-i'(x,y)) 

Li'(x,y) = Li-i'(x,y) + DL(x,y) 

[0037] The compressed series consists of Ii and DI2. . .DLi all of which are 
to be lossless compressed using JPEG, JPEG2000, or other standard methods. 

[0038] The reconstructed images consist of Ii and I2'. . Jn\ The compressed 
series needs to be lossless decompressed using the associated method before 
addition. 

[0039] Another embodiment of the invention is directed to 
decompressing an image or reconstructing the compressed images using an 
associated decompression algorithm to form thxesholded images. Adding each of 
the pixels from each thresholded image with the pixels of its reconstructed 
previously adjacent image creates reconstructed images. 

[0040] The Adaptive Slice Subtraction compression techniques have been 
designed to reintroduce "random noise" dturing the decoding process by 
preserving the noise in the first image. However, if desired, a noise reduction 
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mter may be applied to the first image to reduce noise from the entire series. 
This results in a very fast filter to reduce noise. Decompression or decoding can 
be achieved, for example, as follows: 

[0041] Input: A set of compressed files that were previously encoded 
using either of the above encoders. 

[0042] Summary of Decoder: 

[0043] 1, Decompress the first image and the previously thresholded 
images using the associated decompression technique that reverses tfie 
compression technique used in the final step of the encoder. The first image has 
now been decoded. 

[0044] 2. Pbcel-by-pbcel addition of each of the previously thresholded 
images to the decoded adjacent image, starting with image #2. 

[0045] Output: A set of reconstructed files comprised of images 
pertaining to a single series. These files should contain significant information 
that was present in the original data set. Any loss of pbcel information is 
predominantly noise being discarded. 

[0046] Preferred embodiments of tiie invention are directed to methods 
of storing the images compressed as described above. The compressed images 
are encoded in a storage format including, but not limited to AVI, Bitinap, 
DICOM, GIF, TIFF, JPEG, MPEG, PNG, or Windows Media, and stored in a 
storage medium including, but not limited to fixed disk drives, magnetic disks, 
optical disks, magneto-optical disks, random access memory, flash memory, or 
cache memory. The stored images can be retaieved firom the storage medium and 
viewed, manipulated, or faransmitted using a suitable computer system. 
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[0047] Another embodiment of the invention is directed to methods of 
transferring images compressed as described above. The images are encoded in a 
transfer format and provided to an image source system such as a computer 
system containing storage medixun for the images. The images can then be 
transferred from the image source system through an image transfer mechanism 
(e.g., electronic mail) to an image receiving system such as a receiving computer 
system. Transfer formats include, but are not limited to TCP/IP, DPX/SPX, 
NetBEUI, ATM, or 802.11. Transfer mechanisms include, but are not limited to, 
network, Internet, telephone line, satellite, wireless, microwave, or fibre. 

[0048] Preferred embodiments of the invention are also directed to 
computer systems for compressing a series of digital images comprising a 
computer processor; memory for storing a series of digital images; and logic 
embodied on a computer readable medium, including computer executable 
instructions for arranging said images in an ordered series from 1 to n wherein n 
is the last image in said series. The computer system subtracts each pixel of each 
of images 2 to n from its corresponding pixel in an adjacent image, creating a 
subtracted image. The pixel values are adjusted to zero for pixels having an 
absolute value less than a predetermined threshold value, creating a tiiresholded 
image. The thresholded images are compressed using a compression algorithm 
to form compressed images. 

[0049] It is to be tmderstood that the application of the teachings of the 
present invention to a specific problem or environment will be within the 
capabilities of one having ordinary skill in the art in light of the teadhings 
contained herein. Preferred methods and systems of the invention appear in the 
following examples. 
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EXAMPLE 1 



Near-Lossless Example: Series of 3 images: 4 rows x 4 columns x 16 bits 
Original pixels 
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13 (16 bit image) 
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A lossless compression and associated decompression method can be applied at 
this point. 

Reconstructed pixels 
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Maximum Near-Lossless Compression Error: 



[0050] The maximimi error in any pixel of I2 to In is the maximum of a * 
an. By introducing an upper bound on a * an, this method would qualify as near 
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lossless compression. In the above example, it is evident that significant changes 
are preserved in the near lossless adaptive slice subtraction method. This would 
be the case if images within a series were poorly correlated. 



EXAMPLE 2 



Lossy Example: Series of 3 images: 4 rows x 4 columns x 16 bits 
Original pixels 
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Thresholded pixels 
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3 (16 bit image) 
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Any compression and associated decompression method can be applied at this 
point. 

Reconstructed pixels 
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Maximum Lossy Compression Error: 

[0051] Themaximtimerrorinanypixelof l2tolnisnowan(2(yi). In 
practice, the actual error should be very small so long as the thresholding 
function is not removing dinically relevant data and only removing noise. 
Random noise is distributed tmiformly around 0 and should not accumulate to 
create a significant problem in this regard. In the above example, it is clear that 
there is just a small difference in the output of the lossy version of adaptive slice 
subtraction when compared with the near lossless version. Nonetfieless, this 
technique would not qualify as near lossless even if lossless compression 
techniques were employed in conjxmction with the lossy slice subtraction 
method. 

[0052] This software wiU be used by PACS and teleradiology software 
companies to significantly reduce the storage requirements for diagnostic images. 
The length of time necessary to transmit a study or the transmission bandwidth 
required will also be reduced significantly. The users wiU require a software 
toolkit in the form of an AppHcation Programming Interface (API). This API wiU 
contain a function to compress a DICOM study and a second function to 
decompress the DICOM study. This software can be integrated into existing 
systems with minimal integration work required. 

EXAMPLES 

CT Study 

[0053] Initial tests were performed tasing a 4 detector CT exam at 
512x512x16 bits with average image sizes, uncompressed, at 512KB, and JPEG 
lossless compression at 200KB. 
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[0054] Near lossless slice subtraction where a = 1.5 was conducted in 
accordance with preferred methods of the invention followed by JPEG lossless 
compression at 80KB. Lossy slice subtraction where a = 1.5 followed by JPEG 
lossless compression at 50KB resulted in a visually comparable reconstructed 
image when compared side by side with the original image. 

[0055] Decreasing a did not significantly improve the visual appearance 
of the reconstructed images, but increased file sizes significantly. 

[0056] Increasing a began to degrade the visual appearance of the 
reconstructed images, but decreased file sizes significantly. 

[0057] Preferably, the appropriate setting of a is determined as this 
constant xmiversally influences the size of the threshold range. Preferably, the 
largest possible value that does not visually degrade the reconstructed images is 
also chosen. At the same time, it is preferable to choose a small enough value 
such that the vast majority of our subtracted images satisfy the Normality Test. 

[0058] The above description is only illustrative of preferred 
embodiments which achieve the objects, features, and advantages of the present 
invention, and it is not intended that the present invention be limited thereto. 
Any modifications of the present invention which come within the spirit and 
scope of the following claims are considered part of the present invention. 
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